BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home]
[Evaluation Methods]
[Master Result Table]
[Team Profiles]
[System Profiles]
Final Evaluation Results
on REG-TOTAL events by Ev. Decom. - Approx. Span & Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[REG-TOTAL]== 1940 ( 784) 1408 ( 784) 40.41 55.68 46.83
[JULIELab ] ==[REG-TOTAL]== 1940 ( 777) 1721 ( 777) 40.05 45.15 42.45
[ConcordU ] ==[REG-TOTAL]== 1940 ( 618) 1040 ( 618) 31.86 59.42 41.48
[UT+DBCLS ] ==[REG-TOTAL]== 1940 ( 607) 1168 ( 607) 31.29 51.97 39.06
[VIBGhent ] ==[REG-TOTAL]== 1940 ( 401) 950 ( 401) 20.67 42.21 27.75
[ UNSW ] ==[REG-TOTAL]== 1940 ( 386) 962 ( 384) 19.90 39.92 26.56
[ UZurich ] ==[REG-TOTAL]== 1940 ( 351) 805 ( 351) 18.09 43.60 25.57
[ UTokyo ] ==[REG-TOTAL]== 1940 ( 315) 741 ( 315) 16.24 42.51 23.50
[ Cam ] ==[REG-TOTAL]== 1940 ( 233) 455 ( 233) 12.01 51.21 19.46
[UAntwerp ] ==[REG-TOTAL]== 1940 ( 245) 678 ( 245) 12.63 36.14 18.72
[ SCAI ] ==[REG-TOTAL]== 1940 ( 293) 1269 ( 293) 15.10 23.09 18.26
[ Team 24 ] ==[REG-TOTAL]== 1940 ( 207) 801 ( 206) 10.67 25.72 15.08
[CNBMadrid] ==[REG-TOTAL]== 1940 ( 413) 3659 ( 412) 21.29 11.26 14.73
[ UMich ] ==[REG-TOTAL]== 1940 ( 360) 3845 ( 360) 18.56 9.36 12.45
[ NICTA ] ==[REG-TOTAL]== 1940 ( 167) 751 ( 167) 8.61 22.24 12.41
[ UAveiro ] ==[REG-TOTAL]== 1940 ( 146) 494 ( 146) 7.53 29.55 12.00
[ASU+HU+BU] ==[REG-TOTAL]== 1940 ( 122) 257 ( 122) 6.29 47.47 11.11
[CIPS-ASU ] ==[REG-TOTAL]== 1940 ( 224) 2404 ( 224) 11.55 9.32 10.31
[ USzeged ] ==[REG-TOTAL]== 1940 ( 94) 379 ( 94) 4.85 24.80 8.11
[ UNIMAN ] ==[REG-TOTAL]== 1940 ( 84) 400 ( 84) 4.33 21.00 7.18
[CCP-BTMG ] ==[REG-TOTAL]== 1940 ( 58) 115 ( 58) 2.99 50.43 5.64
[ Team 09 ] ==[REG-TOTAL]== 1940 ( 49) 335 ( 49) 2.53 14.63 4.31
[ PIKB ] ==[REG-TOTAL]== 1940 ( 25) 59 ( 25) 1.29 42.37 2.50
[ KoreaU ] ==[REG-TOTAL]== 1940 ( 13) 32 ( 13) 0.67 40.62 1.32
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[REG-TOTAL]== 1994 ( 614) 1180 ( 614) 30.79 52.03 38.69
[UAntwerp ] ==[REG-TOTAL]== 1994 ( 256) 698 ( 256) 12.84 36.68 19.02
[ Team 24 ] ==[REG-TOTAL]== 1994 ( 220) 819 ( 219) 11.03 26.74 15.62
[CNBMadrid] ==[REG-TOTAL]== 1994 ( 436) 4280 ( 435) 21.87 10.16 13.88
[ASU+HU+BU] ==[REG-TOTAL]== 1994 ( 122) 257 ( 122) 6.12 47.47 10.84
[CCP-BTMG ] ==[REG-TOTAL]== 1994 ( 58) 115 ( 58) 2.91 50.43 5.50
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------